i 



ERIC 



DOGOBEHT BESOBE. 



ED 19t| B35 



CG Om 776 



AUTHOR 
TITLE 

PpBDATE. 
NOTE - 



EDBS Pt^ICE 
tESCBIPTOES 



■IDENTIFIERS 



Bartlirig, Herbert C.t Hdpa, Albert_B. 

Vaiidity of Measured interest for Decid^ed and 

Undecided Student s. / : 

Sep BO ' -j ' i ^ 

16p.: Paper presented at the fl,fnnual Convention of the 

American Psychological ssocia tion ( BBth, Montreal , 

Quebec, Canada, September V'-S; 1960)* 



Congruence 



MF01 /PC01 Plus- Postage. -__ J_ _ 

♦ Career Choice: -^College Gr'ad^atesi 

(Psychology) : Foliowup S^udif s : ^*±nt er est 
Inventories: *Predict ive . Vai5:dity; *Seif Ex pressioh: 
Sex Differences: *Vccatibnal^ Interests 
*ftef" Assessment,: *Sttbhg Vocational- interest Blank 



^ SBSTRftCT . ' V- " > , i J 

T,he usefulness of vbcatidhai interest m^easures has 
been questioned by those who have: studied "the predi|:t ive va I'idity of 
expressed choice* The predictive validities;, of measured interest for 
decided: and undecided students^ expressed choice and measured 
interest^' and expressed , choice and nieasured ' interest, when th§y.are__ 
eonartrent and iticbngrllen^t _ wpre investigated in a follbw-up study of 
50 8 uhiversity graduates 1 llyear s^a fter they had taken the_Strbng 
Vocational Interest Blank (SVIB) and the American College Test. 
Expressed chcice predicted future, occupation more accurately than 
measured^ interest . The ^ accuracy of bo.th variables was greatest when 
t hey were^ congruent . ^.Expressed choice was found to ' be a more accurate 
predictor for women than for men. Predict ive accuracy of the, single 
highest SVIB scale was greater than that obtained f roffl_a grouping of 
syiB scales^ The^ SVI B_ was j^gually - efficient . P^^^i?"^?^? _^95 undeci'ded 
students - as it was ^ f o^-- decided -'student si - T he ^ predict ions of future _ 
cccupational _chQ.ice^ f rom SVIB profiles yielded lower "hit rates" than 
the retrospective method used in mbst validity ^tudiesi 
(Authbr/NRB) ; ' ^ • 



****jfe*********:(c**3ft3ft3(K ******* **** *5k**^************^ ****** ****** 

♦ , Re fjro'd uct ion s supplied :bv EDPS^are the best that can be made ' * 

^ ^_ ^_i?95^^^?_o^?-^r5?^ document. ^ 

**************************************************** 



EKLC 



Va3^d±ty of Measured liitfetrept 
for Decided and Undecided Studentis 



Herbett Bartling 



Mbert B. Hood 
The University of Iowa 



Poster Session: Assife^ssment , . 
Methodology, and Research Issues 

Eighty-Eighth Annual Convention of 
the American Psychological Association 



September 1-5, 1980 



■ Division of Cbunseldr Education 
^ . N 338B tindquist Center . " 

- .» „ The University of Iowa 

^ iowa City, Iowa 52242 , 



CO 



EKLC 



U S OEPARTMENTOF HEALTH. ^ " PERM ISSION TO REPRODUCE TH IS 

EDUCATION A WELFARE . MATERIAL HAS BEEN GRANTED BY 

NATIONAL.I^ASTIT_OTE OF - . - 

— .T,o. . r?i/^^y. 

THfS DOCUMENT HAS BEEN REPRO- , • ■ - 

buCE-b -E-XAC-T4.Y RE-GEIVEC> JPROJVi ' " . 

T H E. P.E. R S O N . O R 0 R G A N A T 1^ N O. R J G t. N.- , , ^ ^_ • 

ATINGIT POINTS OP VIEW OR OPINflONS 
STATED .00. NOT. NECESSA'RjGy RE iPRE- 

SENTOPPlClALNATlONALINSTITUTEOf- -- --- 

EbuCATibfst PbsiTioN OR POLICY . TO THE: EPUCATI£)N_A1J RES-QU RCES 

. . ' INFORMATION CENTER (ERIC):" 



Validity of Measured Interest for Decided arid Undecided Students 



/ 



The purposes of this study were (1) to deteinnirie the predictive 

validity of ^measured interest for decided arid, Uridetided students^ 

'1 - - -I - -^^ ^ ^ ' 

(2) to investigate the predictive validities of expressed choice 

and measured interest^ arid (3) to determirie the 'predictive validity 

of these indices when they are cbrigru^rit arid when they are iricongruent 

The usefulness of voQationai interest measures has been 
questioned by those who have studied the predictive validity of 
expressed choice. Doiiiver (1969) reviewed studies of the SVIB arid 
expressed interest and concluded that "the predictive validity of 
fexprgssed interests is at least as great as the predictive > > 

validity of the SVIB, In no study where direqt cbmparisbri was 

. / ...... . * - ' . ■ . 

'^ade.^.was the SVIB as accurate as the expressed interests iri pre-, 
dieting occupation engaged in" (pp- 103-104) • ' 

Expressed career choice has been shown to have predictive 

validity equal to that of measured int erest , at least in' £he short- 
terin studies reviewed by thesy/^authors . The questions remain: 



which has the greatest predictive validity over a long time-span, 
arid how do expressed chol^ and measured interest validities com- 
pare wheri the^ are con^gruent and when they are incongruent. A 
study over a three-5rear' span by Borgen and Seling (1978) showed 
more accurate prediction when the two indices were congruent. 



In all fbllbw-up studies, except Borgen and Seling's, the 
current bcciipatibri bf the subjects wais deteririlned atjd the test 
results i which had been obtained at an earlier time, were examined 
to determine if they were in any way predictive of current occupation 
The retrbspective cbmparisbh differs from the problem faced by a 
cbiinselbr whb must examine current test results and predict to 
future bcciipatibri, Therefbre,. to more closely approximate the 
cburiselbr*s use of the SVIB, predictive validity in this study was 
determined by making a prediction of a future occupation from the 
SVIB results and then examining current occupatidns to determine th^ 

accuracy of such predictions. 

_ - _ _ _ _ " " "J 

Another problem faced by cburiselbrs in predicting ftbm expressed 

career choices is thpt a nu^iber of their clients are unable to narrow 

thfeir -choices. Indeed; it is this iriability to express any type 

of career choice that motivates them to seek the assistance of a, 

counselor V It is therefore impbrtarit tb detemine the predictive 

validity of a vocational iriterest^ iriveritbry fbr these "undecided" 

clierits who do rib t^ have ari expressed chbice. 

Method 

Subjects " , 

Data were cbllect^d bri all freshmen who entered South Dakota 
State university (SDSU) in the fall of i967. Complete data were . 
available for all but 10 of the 1432 students in the freshman class. 



Of th^ i422 freshmen, 835 had graduated from the University by 
1974 and addresses were available in the alumni files in 1978 for 
641 of them; The free use of a nation-wide WATS line was secured from 
a- local , industry after two mailings had yielded 292 completed question- 
naires. Telephone numbers Were obtained for 153 of the 349 non- . 
respondents, and 116 responded to the questionnaire items over the 
:phbne. The total number of 408 respondents (239 males, 169 females) 
represented 64% of the 641 graduates for whom addtesses were available. 

Instruments 

The ACT (American College Testing Program,, 1966) which was 
ttaken by students at that tlme^ was a two-part instrument consisting 
of a student profile section and scholastic aptitude tests of 
English, Mathematics^ Social Studies, and Natural Sciences. The 
V Strong Vocational Interest Blanks (SVIB) used weie the Men.' s Booklet 
(Fopn T 399) and the Women's Booklet (Form W - Machine Edition). 

A brief five-item questionnaire, designed t^' elicit .(1) present 

_ f _ 

occupation^ (2) usual bccuiJatibit, (3) level of occupational 

_ __ .:: _:. _ ^ __ 

satisfaction, and (4) influences (2 itans) on entry^ into present 

occupation, was mailed to the graduates in the fall of 1978. 
Procedure 

Holland 3-letter codes were assigned to expressed choices, 
measured interests, and present occupations, using the Holland 
Occupational Classification Alphabetical Index (Holland, 1972) and 
Vierhstein's Extension (Holland, 1972)i 
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the SVIB "profiles" were given S-letter codes in two ways: 
(i) by using the code of the bccupatd^bnal scale with the .highest 
standard score (SVIB-H) and (2) by u^ing a pattern or group 
technique (SVIB-G) . ' % ^ 

j Holland 3-letter codes were assigned to the graduates' 
present occupations using the same procedures that had been used 

to fifeode expressed choices. "Usual" bccupatidri was used only ±f ^ 

\ ] _ . 

it differed from "present" bccupatidri; for example, those currently 
unemployed^ or women who had interrupted another career for home- 



Predictive i^curacy was categorized ais a "Good Hit," "Poor 
Hit," or "Clean Miss" (Table 1). This method is an adaptation of 
the agreement index used in studies of the Self-Directed S^rch 
(Holland^ 1972; Zener^ & Schriuelle, 1972) to assess the degree of 
agreement. between two sets of 3-letter codes. 

Results 

Prediction of Futttre O ccupation ^ 

The degree of agreement score between each of the five pre- 
dictors arid the criterion (usuai occupation) for each individual 
was defiried as a "Good- Hit," "Poor Hit," or "Glean Miss," as was 
shown in Table 1.* 



f 



Table 1 

Score Value arid Accuracy of the Degree of Agreernejit; Between 
Pairs of 3-Letter Hbllarid Codes 



Definition 



Score Value 



Adcuracy. 



Letters and order exactly the 
same ^e.g., RIE, RIE) 

First and second letter of the 
first code match first and second 
letters M3f the second code (e.g., 
RIE, RIG) 

First letter of [the first code 
matches 'the first letter of / he 
second code and the second and 
third letters are reversed _ 
(e.g., RIE,_ RED 

tetters of the first code match 
letters of the second code, but 
not in order (e.g., RIE, 



(3ood Hit 
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Eirs-t letter of the first code 
matchesthe- first letter of the 
second code (e.g., RIE, RSC) 

First and second letters of the 
first code match any two letters 
in the second code (e.g., RIB, ISR) 



Poor Hit 



First letter of the first code 
matches any letter in the second, 
code (e.g., RIE, CRS) 

Firstietter of the first code 
X§ not included in the other code 
(e.g. , -RIE, GAS) 

i 



Clean^ Miss 



i The hit rates for the three expressed choice predictors arid the two 
^ measv^red interest predictors are shbvm in Table 2. Results of the 

hit rate analyses clearly support the cohclusibh that the predictive 

^. __ _ .. _ ■ » ^ _ ' . . 

accuracy of expressed choice is greater than the predictive accuracy 

of measured interest. , the three expressed choices differ little 1^ 

predictive accuracy. Measured interest (SVIB) is not as accurate as 

expressed chbice whether using the single highest bccupatidnal scale 

or the grouping procedure devised for this study. The results also 

indicate that this grouping of occupational scales (SVIB-G) , does not 

predict future occupation' as accurately as does the single highest 

Qccupatiohal scale (SVIB-H) . 



Table 2 : 

Hit Rates (Expressed as Percentages) of Men ' S-and^Women 's 
Expressed Choices and Measured Interests 



Predictor 


Nuiaber 




Hit 


Poor 


Hit 


Clean Miss 
Men Women 


Men 


Wbineri 


Men 


Wdmeit 


Men 


Women 


Expressed Chbice 
















ACT SPS: Majbr 


173 


133 


41.7 


60.8 


26.7 


22.3 


31.6 16.9 


Vocatibh 


173 


133 


43.9 


57.5 


25.9 


25.9 


30.2 16.6 


Freshman Majbr 


194 


144 


50.2 


60.9 


22.9 


23.6 


26.9 15.5 



Measured interest ; ^ 

SVIB-H < 234 150 32.5 32. 7 27.4 26.0 AO. 1 A1.3 

SViB-G 234 150 31.2 13.3 28.6 26.7 40.2 60.0 
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; inspection of the hit rates for men and v/bmeh reveals that 
expressed ^oice predixitorsf^are more accurate for women than for V 
men. The higher hit rates found for expressed choi^ predictors 
among the women may be due to the narrower range of "ohoice avail^^ 
to them'. Perhaps these women made a more accurate expressed 
choice than the men because their career choice^ were restricted 
to those regarded as "fitting" by their^ parents, and society, 

Cbhgruehce of Expressed ChQice ^ad— Ife asUred Itttere ^ 

A problem often faced b^' cduriseldrs is the~amount of weight 

to place on e'xpressed chdice and interest test results when the 

two are incdtigru^nt, - In this portion of the study, congruence 

between expressed chdice and measured interest was defined by 

/ 'f\ _ _ _ . _' 

degree of agreement scores, of 6, '5, and 4, incongruence was 

defined by degree of agreement BcoTes of 1 and 0. The middle . 

values of the agreement scale, i and^2 were not included in - , 

eltfier ^definition and students<<«lth^uch scores were eliminated 

ftpm these^ analyses. ^ ' ^ 

•The hit- rates for the cbhgifueiit and incbngruent grdups are 
shown in Table 3. The predictlVje* accuracy of expressed chdice 
■■_ (60% Good Hits) and measured interest (56% Gddd Hits) - is 
greatest when they are congruent. ^ When expressed chdice and 
measured interest are incbngruent, the predictive accuracy df 
both is diminished. In this c^se, however, expressed ^choice with 
47% Gbbd Hits is a substantially better predictor than measured 
interest with dnly 9% Gddd Hits. 



Table 3 



Hit Rates (Express^: as Percentages) of Congruent 
and Incongruent Expressed -Cho ices and Measured Interests 



Predictor 
Relationship 



Current Study 



Bbrgeri^ 



Predictor 



N 



Good 
Hit 



Poor 
Hit 

J. 



Clean 
Miss 



N 



Good 
Hit 



All-igribripg 
Congruence 



Expressed 

^'cd 
Measured 



- t J 

321 U^-.^^^1S.9 24.3 609. 52.4 

384 32.5 V 26.9 40.6 .609 40.2 



Cbhgrueht 



Incongruent 



Expressed 
HieasurecJ 

Expressed 
Measured 



96 


60. A 


19.8 


19.8 


96 


' 56.2 


24. 0 


19.8 


70 


47.2 


21.4 




10 


8.6 


1A.3 


'77.1 



218 70.0 

218 70.0 

391 41.4 

391 22.5 
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fgen and Seling (1978)' 
SPS Vocation 
'Current Study: ^ SViB-H 

^Borgen: SVIB - 22 occupational scales 



This pattern of htt rates suggests that when the two predictors are 
in agreement, a counselor and client shield give considerable weight 
to both predictors.' When expressed ct^oice and measured interest do not 
agree however, expressed choice should be given the more serious con- 
slderation of the two. 



Predictive Accuracy For Undecided Clients 

Studies of the predictive accuracy of. expressed choice do n^t 
help a counselor v/orkihg with a client who has riot ttiade a choice and 
is seeking help In maklrig. a declslbrii To provide such Irifbrtnatlon 
for counselors, the predictive accuracy of the SVIB for vocationally 
undecided students was examined. Students who had indicated on the 
ACT SPS that they were unciecided about their future vbcatlbri were 
classified as Undecided. Those who had -marked a future vbcatlbri were 
classified as Decided. The hit rates f br^SVIB-H arid SVIB-G fbr 
Decided and Undecided studerits are shown iri Table 4. 



T^ble 4 

Predictive ,Accuracy bf Measured Interest 
fbr Decided arid Uridecided Students 



Predictor ' Group N ^ % Good Hit % Poor Hit % Cleari Miss 









V 








SVIB-H 


Decided^ 


301 


32.5 




27.5 


40.0 




^i;. Undecided^ 


66 


34.8 




19.7 


45.5 


SVIB-G 


Decided 


301 


22.9 




27;6 


49.5 




Undecided 


66 


3ii8 




24; 2 


43.9 


















4 













^ Selected a future vbcatlbri frbm the ACT SPS list. Twerity were 
Und:ecided bri the SVIB arid bmitted. y 

^ Selected__"yridecided" frbm the ACT SPS list. Three' were Undecided 
bri the SVIB arid bmitted. ^ 
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SVIB-H predicted usual occupation as accarateiy for Undecided students 
(Good Hits = 35%) as for Decided students (Good Hits - 33%). The 
results indicate that the SVIB-H can be used with undecided students 
in exploring vocations with the knowledge that it is as accurate a 
predi(itdr for them as it is for other students. Although couriselbrs 
might well hope for better hit rates than were obtained in this study ^ 
the 35% Good Hits for Undecided students is stiii well above a chance 
probability of less than 10%. . 

Discussion 

The findings again established the superiority of expressed choicd' 
over measured interest. Moreover, expressed choice was found to be an 
even more accurate predictor for wbmeri than for men. The results also - 
suggest that in predicting to specfT^ic occupations, the single highest 
occupation on the SVIB profile is the most accurate predictor,' 

Cbmparisbh V7ith Other Studi^ 

number of predictive studies of the Men's form of the SVIB have 
been performed using a predictive time span approximating that of this 
study, .A cbmparisdn of the predictive validities of the earlier studies 
arid the current study is shown: in Table 5. The results of ear.lier studies 

/ ..^ ■ : ' . , ; -^--^f-^^-.--- ^ , ■ _ 

-are remarkably consistent, probably^*ecause the methods employed were very 
similar. Predicting a future occupation from an SViB profile is a more 
' difficult task, but i§ similar^ to that faced by the counselot;. The 

different type of prediction method used probably a-ccounts for -the lower - 
hit rates obtained in the current , study ^ . • ^ • - 
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Table 5 

Cbtnpariison of Earlier and Current SVIB 
Predictive Validity Results 



Accuracy Strong McArthur triinble Briandt Dolliver Doiiiver Current 

& Hood Irvin & & Will Study 
Bigley 



Good hit 


48% ■ ' 


- 45% 


49% 


48% 


42% 


49% 


-32% 


Poor hit 


18% 


20% 


17% 


20% 


12% 


21% 


27% 


eieari miss 


34% 


35% 


34% 


32% 


46% 


30% 


41% 


Method^ 




2 


2 * 


3 


2 




5 


N 


524 


60 


120 


259 


130 


47 


384 


















Sex 


M 


H 


M 


M 


M 




M-W' 


Year Span 


18 


14 


io 


7 


12 


io 


11 



^(1) Strong. Good hit = A's^ Poor hit = B-f' s , Clean miss = B-C's. 
(2) McArthur. Good hit ^ A's or an bcwpatidri which had 1st, 2nd, or 
3rd highest ranking; Poor hit = B-f'S; Clean .miss Anything below. 
C:3^ Brandt & Hood. Pattern analysis using McArthur's rules. 
^^(4) Dolliver & Will. Good hit = A's S B+'s, Poor hit = B's & B-'s, 
Clean -miss =^ C's. 

(5) Current Study. Agreemefnt of Holland codes. Good hit = 6, 5, 4; 
^P9<jfnm = 3, 2; Clean miss = 1, 0. 

^28 Sen and 19 women, all took the SVlB-M. 

^234 men ~SVIB-M; 150 women - SVIB-W. 
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Congruent arid Incongruent Inte rests 

The results comparing the accuracy of expressed choice and measured 
interest when they are congruent and when they are incongruent substan- 
tiated what has been shown in several other studies. The results of the 
Bdrgeti and Seling study, which were compared with the results of the 
current study in Table 3, predicted "career choice" over a three^^ear 
time span as opposed to predicting actual occupation engaged in 
(eleven years later) as was done in this study. This difference in 
time span, -and Borgen and Seling 's use of discriminate analysis 
involving 22 scales of the SVIB, probably account for their somewhat 
higher hit rates lor measured interest - 

Undecided Students 

The impdrtaht finding cbricerriirig the predictive accuracy of the 
SVIB for students who are vbcatibrially Undecided was that the SVIB had 
a hit rate of 54.5% for these students- Although not as high as the 
"Good" and "Poor" hit rate (60.0%) for those students who had made a 
vbcatibhal decisibri, this result clearly indicates that the SVIB, or 
sbme bther measure bf interest, can provide needed direction for the 
student who has not~-ma^ a choice. 

Conclusion 

^ This study answers some of the quest|.bris which have been raised 
about the value bf vocational interest measures by shbwihg that the 
SVIB improves on chance ^ arid thus is useful in rbirifbrcirig decisions 



made by students who have cho5;en an occupation as well a,s for exploring 



possible clioicGs for these wlio liave not; 



This was the first large-scale fdllow-up' study of women's 
career choices over a long time-span^ but^ women's careers v/ere 
begiririirig to enter a state of tratisitiori at the time this study 

was begun and this trarisitidri continued throughout the 11-year 

-- -- - - - 

period covered in the study. Theref ore ^ the results may not be 

applicable to women who are now entering the work world arid 

another study of the predict! /e validity of these measures f or 

women should be undertaken wheri this peri^ of trarisitidri erids 
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